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Fast a-type inhibitory neuron with delayed 
feedback has non-markov output statistics 

Alexander K.Vidybida * 


Abstract 

For a class of fast CZ-type inhibitory spiking neuron models with 
delayed feedback fed with a Poisson stochastic process of excitatory 
impulses, it is proven that the stream of output interspike intervals 
cannot be presented as a Markov process of any order. 

Keywords. Poisson stochastic process; spiking neuron; probabil¬ 
ity density function; delayed feedback; fast Cl-type inhibition; non- 
Markov stochastic process 


1 Introduction 

Spiking statistics of various neuronal models under a random stimulation 
has been studied in the framework of two main approaches. The hrst one 
is named in [1] as “Gaussian”, because it describes random stimulation by 
means of Gaussian noise, see e.g. [2]. This approach has developed into 
the well-known diffusion approximation methodology, see [3]. The second 
approach is named in [1] as “quantal”, because it takes into account the 
discrete nature of the influence any input impulse may have on its target 
neuron. The wide area of research[4, 5, 6] and applications [7, 8, 9] known as 
spiking neural networks, see [10] for a review, could be considered as utilizing 
the quantal approach. 

For a recent review of mathematically rigorous results as regards neuronal 
spiking statistics in the both approaches see [11]. 

We study here mathematically rigorously, in the framework of quantal 
approach, spiking statistics of inhibitory neuron model belonging to a class 
of models (see Sec. 2.1, below) with fast GZ-type inhibitory delayed feedback. 
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This construction is stimulated with Poisson stream of excitatory input im¬ 
pulses. For this conhguration it was proven in the previous paper [12] for a 
concrete neuronal model — the binding neuron^ with threshold 2 —, that 
statistics of its ISIs is essentially non-Markov. In this paper, we rehne and 
extend methods of [12] making them applicable to any inhibitory neuron 
with fast CZ-type inhibition satisfying a number of simple and natural con¬ 
ditions. Under those conditions, we prove rigorously that ISI statistics of 
a neuron with delayed fast U/-type inhibitory feedback stimulated with a 
Poisson stream of input impulses cannot be represented as a Markov chain 
of any hnite order. 

A similar statement has been proven recently for a class of excitatory 
neuronal models [14]. Here we extensively use the approach of paper [14] 
modifying it as necessary to cover the case of the (PZ-type fast inhibition. 


2 Definitions and assumptions 

2.1 Neuron without feedback 

We expect that a neuron satishes the conditions Cond0-Cond2 of [14]. As 
regards the CondS, Cond4 of [14], for the Cl-tjpe fast inhibition those con¬ 
ditions should be modihed as follows: 

• CondS: Just after bring, neuron appears in its resting state. 

• Cond4: The output interspike interval (ISI) distribution can be char¬ 
acterized with a probability density function (pdf) p^{t), which is con¬ 
tinuous with 

/(O) = 0, (1) 

positive: 

t>0^ /(t) > 0, (2) 

and bounded: 

supp°(f) < cxo. 
t>o 

Also, we impose on the function p^{t) the following condition 
p^{t) = 0 in order to have it debned for all real numbers. 

The CondS, above, limits the set of models as compared to [14]. Namely, 
it claims that the standard state of [14, CondS] be exactly the resting state of 

^Detailed description of the binding neuron model can be found in [13]. 

See also https : //en. Wikipedia. org/wiki/Binding_neuron. 


( 3 ) 

: f < 0 
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neuron. This requirement is imposed due to the specihcs of CZ-type fast inhi¬ 
bition. Without specifying neuronal model exactly, one can dehne the resting 
state as that achieved if the neuron does not receive any input for inhnitely 
long time. For our purpose it is important that after receiving inhibitory 
impulse, the neuron appears in exactly the same state as immediately after 
bring. And the state after receiving CZ-type inhibitory impulse can be only 
the resting state, see Sec. 2.2.1, below. 

The Cond4, above, seems to be as natural for any neuronal model stim¬ 
ulated with Poisson stream as does corresponding condition from [14]. Its 
difference from [14] has a pure mathematical nature and is suitable for the 
proof in the case of C'Z-type fast inhibition. It seems, that this conditions are 
natural for many threshold-type neuronal models known in the literature, 
see [15, 16, 17, 18] and citations therein. But this still has to be proven by 
calculating corresponding p^{t). At least, all the hve conditions are satis- 
hed for the binding neuron model and for the basic leaky integrate-and-hre 
(LIF) model, see [19, 20], where p^{t) is calculated exactly for each model, 
respectively. 

2.2 Feedback line action 

We expect that the feedback line satishes Propl, Prop2 of [14]. The Prop3 
of [14] should be modihed for the C'Z-type fast inhibition as follows: 

• Prop3: The impulse conveyed to the neuronal input is the fast C'Z-type 
inhibitory impulse. This means that after receiving such an impulse, 
the neuron appears in its resting state. This exhausts the action of 
the inhibitory impulse in a sense that it has no influence on further 
neuronal states created by next excitatory impulses. It as well does 
not affect neuron if founds it in its resting state. 

2.2.1 Biological justification^ 

Neurons, which send inhibitory impulses onto their own body, or dendrites 
are known in real nervous system, see [21, 22, 23, 24]. 

The chief inhibitory neurotransmitter in the nervous system is Gamma- 
aminobutyric acid (GABA). The GABA can activate several types of recep¬ 
tors, the main of which are GABA^ and GABA;,. If GABA^ receptors are 
activated, the excitable membrane becomes permeable for Cl~ ions. If a 
neuron is partially excited, that is its membrane is depolarized to an extent, 
the Cl~ current cancels this depolarization since the Cl~ reversal potential 

^see also text in Sec. 2.2 Feedback line action of [14] 


3 



is close to the resting potential. For the same reason, the Cl~ current does 
not appear if the membrane is at its resting potential. This explains partially 
where does the Prop3, above, come from. Another case is with GABA;, recep¬ 
tors activation. This causes ions permeability. The outward current 
is able to hyperpolarize membrane even below its resting potential. The 
remarkable difference between GABA^ and GABA;, mediated inhibition is 
rather different kinetics of the corresponding Cl~ and currents. Namely, 
according to [25], the Cl~ current rise time is 1 - 5 ms, and the decay time 
constant is about 10 - 25 ms. The current rise time is 10 - 120 ms, and 
the decay time constant is about 200 - 1600 ms. The current can be even 
slower, see [23, 26, 27]. Having in mind this contrast in the speed of Cl~ and 
transients, we idealize the Cl~ current kinetics as having inhnitesimally 
short rise time and inhnitely fast decay, both can be achieved with inhnitely 
large Cl~ conductance at the moment of receiving inhibitory impulse. This 
additionally explains where does the Prop3, above, come from. 

Finally, it should be mentioned that our consideration will be valid also 
for artihcial hardware neurons, see [28, 29], and abstract neurons used in 
mathematical studies, provided Gond0-Gond4 and Propl-Prop3, above, are 
satished. 

The important for us consequence of Prop2 of [14] is that at any moment 
of time the feedback line is either empty, or conveys a single impulse. If it 
does convey an impulse, then its state can be described with a stochastic 
variable s, s g] 0;A], which we call further “time to live”. The variable s 
denotes the exact time required by the impulse to reach the output end of 
the line, which is the neuron’s input for inhibitory impulses, and to leave the 
line. Here, A denotes the delay duration in the feedback line. 

3 Results 

Our purpose here is to prove the following Theorem^: 

Theorem 1 Let a neuronal model satisfies conditions CondO-Cond^, above. 
Expect that the model is extended by introducing a delayed fast G/-type 
inhibitory feedback line, which satisfies the Propl-PropS, above. Then, in 
the stationary regime, the output stream of ISIs of the neuron cannot be 
presented as a Markov chain of any finite order. 

similar theorem for the excitatory feedback line has been proven in [14] 
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3.1 Proof outline^ 

Let \ tn, ■ ■ ■, to)dtn+i denotes the conditional probability to get the 

duration of (n + 2)-nd ISI in the interval [tn+i;tn+i + dtn+i[ provided that 
previous n+1 ISIs had duration ,to, respectively. From the definition 

in [30, Ch.2 §6], one can obtain the necessary condition 


ti G -j = 0,..., n + 1, (4) 


required for the stochastic process {tj} to be nth order Markov chain. 

We intend to prove that the relation (4) does not hold for any n. For this 


purpose we calculate exact expression for | t 


,to) as 


I 4,... ,to) = 


p^^^(4+i,tn,... ,to) 
... ,to) 


( 5 ) 


from which it will be clearly seen that the to-dependence in | 

t„,...,to) cannot be eliminated whatever large the n is. In the Eq. (5), 
expression ..., ti) denotes the joint probability density function of 

ISIs duration of neuron with the fast Ct-type inhibitory delayed feedback. 

Let us introduce the conditional joint probability density ..., to I 

s), which denotes the conditional probability density to get n + 2 consecutive 
ISIs {t„+i,..., to} provided that at the beginning of the first ISI (to) the 
time to live of impulse in the feedback line was equal to s. This conditional 
probability can be used to calculate required joint pdfs as follows 


A 

0 


where /*"'^(s) is the stationary pdf which describes distribution of times to 
live at the beginning of any ISI in the stationary regime. 

In what follows we analyze the structure of functions /*”^(s) and 
... ,tQ \ s). It appears that has a singular component a6{s — A) with 

a > 0, and ... ,to I s) has jump discontinuities at dehnite hyper¬ 

planes in the (n -|- 3)-dimensional space of its variables (tn+i, ■ ■ ■ ,to,s). After 
integration in (6), some of those discontinuities will survive in the {n + 2)- 
dimensional space of variables (fn+i, • • • ,^o), and one of those survived has 
its position depending on to- The to-dependent jump discontinuity will as 

"^The proof outline is very similar to that of [14], therefore, it is abridged here. Please, 
consult with [14]. 
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well survive in the | tn, ■ ■ ■, to) for any n, provided that , tg 

satisfy the following condition: 

n 

(7) 

i=0 

where A > 0 is the full delay time in the feedback line. Taking into account 
that the equation in the necessary condition (4) must hold for any set of 
tn+i,... ,to, we conclude that (4) cannot be satished for any n. 

3.2 The proof 

3.2.1 Structure of functions ... ,to | s) 

Specihcs of the feedback line action together with condition (7) results in a 
very simple structure of , to | s) at different parts of the integra¬ 

tion domain in (6). Those parts are dehned as follows: 

k—1 k 

Dk = {s\^ti<s< ^ti}, A; = 0,... ,n, 

2=0 2=0 

n 

Dn+l = {s \ y^Ji < s < A} . 

i=0 

As regards the structure itself, the following representation can be derived 
similarly as it was done in [14]: 

... ,to I s) = 

( fc-i \ fc-i 

4 I s - 

i=0 J i=0 

s e Dk, k = 0,...,n, (8) 

( n \ n 

tn+l I 5 - ^ t* j S e Dn+1. (9) 

( n \ n 

4+1 \A- n (10) 

2=^+1 / i=k-\-l 

Here \ s) denotes the conditional pdf to get ISI of duration t if at its 

beginning, time to live of impulse in the feedback line is s. 

Representation of • • • ,4 I s) by means of p^(t) and p^'^^it \ s) 

found here is similar to that found in [14] for the excitatory case. But the 
structure of function p'‘^^{t \ s), used in that representation, is different. 
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3.2.2 Structure of function | s) 

Expect that at the beginning of an ISI, there is an impulse in the feedback 
line with time to live s. Then the probability that this ISI will have its 
duration t < s does not depend on the feedback line presence. Therefore, 

t < s ^ I s) =/(t). (11) 

In the opposite situation, receiving of an ISI duration greater than s 
happens if (i) the neuron does not hre during interval ]0;s[ and (ii) the 
neuron starts at its resting state (Prop3, above) at the moment s and fires at 
t > s. Realizations of events (i) and (ii) depend on disjoint segments of the 
input Poisson stream. Therefore, (i) and (ii) are statistically independent. 
The probability of (i) is as follows: 


P°(s) = 1 - y P^{t)dt. (12) 

0 

The probability of (ii) is p^{t — s). This gives 

t> s ^ I s) = P°(s)p°(f - s). (13) 

It can be concluded from (11) and (13) that 

hmp(t I s) = p°(s) and limp(f | s) = 0. 

tfs t^S 

Now, taking into account (1) and (2) from Cond4, above, we conclude that 
the function p^'^^it \ s) considered as a function of two variables (t, s), t > 
0, s g] 0; A] has a jump discontinuity along the straight line t = s. The 
magnitude of this jump is p°(s), and it is strictly positive for positive t. 
Concrete values of p^"‘^{t \ s) along the line t = s does not matter and can 
be chosen arbitrarily. 

Finally, for p'‘^^{t \ s) we have® 

p*""(f I s) = x(s - t)p^(t) + P°(s)/(t - .), (14) 

where x(s) is the Heaviside step function. 

^Compare this with [31, Eq. (11)], where | s) is calculated exactly for the binding 

neuron model. 
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3.2.3 Structure of probability density function 

It appeared that the structure of is exactly the same as it was found 

in [14] for the excitatory case. This structure is as follows®’’^ 

/“'•(s) = g{s) + aSis - A). (15) 

where a > 0 and g{s) is bounded continuous function vanishing out of interval 

|0;A|. 


3.2.4 Form of , to) and , to) after integration 

in (6) 

n 

Let D = U D,. At D, representations (8) and (10) are valid. Also at D, 

k=0 

/*"^(s) reduces to g{s). Therefore, 




ink ( 


D 


W.|A- 


ti X 


A:=0 


X 


i=k+l 


n r ( \ 

n I 5 ) 9{s)ds. (16) 

= 0 d, \ j=o J 


i ^ k 


The first factor (with fixed k, 0 < k < n) in the r.h.s. of Eq. (16) is as 
follows: 

A- 

\ i=k-\-\ 

Due to Eq. (14), this factor does have a jump discontinuity along the hyper- 

n+1 

plane ^ t* = A in the space of variables (to,... ,tn+i). Notice, that the 

i=k-\-l 

position of this hyperplane does not depend on to for any k E {0,..., n}. 

n 

The second factor in the r.h.s. of Eq. (16) is as follows: ][][ p^{U), and 

i = 0 
i ^ k 

it is continuous. 

®The proof can be found in [14]. 

^Compare this with [32, Eqs. (14)-(16)], where /(s) is calculated exactly for the binding 
neuron model. 




The third factor in the r.h.s. of Eq. (16) can be transformed as follows: 


k 



j=0 





0 


k-l 

0^ ( S + tj ) ds 

j=0 


/ k—1 \ 

f P°(s)/(4 - ( s + ) ds 

i \ j=o J 


(17) 


The last expression is continnons with respect to variables (to, • • •, Wi)- 
Therefore, one can conclude that expression (16) does not have a jump dis¬ 
continuity, which position depends on to. 

Consider now the remaining part of integral in (6). With (9) taken into 
account one has: 


j p^-\t,,+u---,to\s)r\s)ds = 

-^n+1 



s - '^tA r‘‘‘(3)ds. 

i=0 J 


( 18 ) 


n 

Here, the hrst factor, ])([ p^{ti) is continuous and strictly positive for positive 

i=0 

ti- The second factor can be transformed as follows: 



Dn-\-l 




s = 


i=0 


I tn+1 I S 


E u 

i=0 


r*(s)d 


s = 


i=0 


A-E ii 

i=0 


p^^\tn+i\s)r^\s + Y,u]ds. (19) 

i=0 
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Now, let us use representations (14) and (15) in order to figure out which 
kind of discontinuities does the expression (19) have. Due to (14) and (15), 
expression (19) will have four terms. The first one we get by choosing the 
first term both in (14) and (15): 


A-E 

i=0 

4lii = J X(s 

0 




)p^{tn+l)g ( s + j ds. 


i=0 


This term is either equal to zero, if > A — ^ fj, or otherwise transforms 

i=0 

into a continuous function of variables [to,, tn+i)- Moreover, 

lim Auitn+i) = 0. 

n 

in+lT^— ^ 

i=0 


The second one we get by choosing the second term in (14) and the first 
term in (15): 


A-E U 

i=0 


^21 — 


J P°(s)p°(t„+i - s)g ds. 


This is as well a continuous function of variables {Iq, ..., f„+i). 

The third one we get by choosing the first term in (14) and the second 
term in (15): 


A-E ii 
1=0 


. i=0 


A^2 = a I x(g - tn+i)p^(tn+i)S \^y^ti + s-Aj ds 

/ n+l 

( A - j/(4+i). (20) 


i=0 

This term has a jump discontinuity along the hyperplane 

n+l 


A . 


( 21 ) 


i=0 
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The forth one we get by choosing the second term in (14) and the second 
term in (15): 


A-E 4 

i=0 


A 22 — tt 


s — A ds = 


j P°(s)p°(t„+i - U 

0 Vi=o 

= P° [ A - ^ ti j / [ ^ - A 


i=0 


, i=0 


This is as well a continuous function of variables (fg, • • •, tn+i)- 

After taking into account the above reasoning, we conclude that the re¬ 
quired joint probability density has the following form 


n+1 


n+1 


^inh 


p‘ 


( 4 + 1 ,..., to) =p'^{tn+i,...,to) + ax Ylp^itj)- (22) 


i=0 


j=0 


where function p'^{tn+i, ■ ■ ■ ,to) does not have a jump discontinuity depending 
on to, and the second term in (22) does have such a discontinuity along the 
hyperplane (21). 


Form of , tg) after integration 

If (7) is satished, then we have similarly to (8), (9) 


... ,to I s) = 


k—1 \ k—1 


= ■ ■ ■ ,4+1 I A)p 


ink 


4 I s - ) JJp°(ti), 

i=0 / i=0 

s G Dk, k = 0,... ,n — 1, 


n—1 \ n—1 


P^'^^itn, ...,to\s)= ( 4 I S - J JJp°(ti), S G Dn- 

i=0 J i=0 

Again due to (7), and in analogy with (10) we have instead of the last two 
equations the following one: 


p*""(4,...,4|s)=p*"" 



k—1 \ n 

) n 

i=0 J i = 0 

i A k 

s e Dk, k 


0, (23) 
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It is clear that expression similar to (9) turns here into the following 

n 

...,to\s) = S G Dn+i. (24) 

i=0 

Now, due to (23), (24) we have 


. . . , to) = / , to I S)r>^{s)ds = 




fc-i 


tfc I s 


k=0 i = 0 
i ^ k 


Dk 


^ti j ^(s)ds + ]^p°(ti) f f^'^{s)ds. 

— ' i=o J _ 

(25) 


Dn-\-\ 


From calculations similar to those made in Eq. (17) it can be concluded that 
• • • 1 to) is continuous at the domain dehned by (7). 


3.2.5 to-dependence cannot be eliminated in p*”^(t,i+i | t„,... ,to) 

Now, with representations (22) for p*”''^(t„+i,..., to) and (25) forp®”^(t„,..., to) 
we can pose a question about the form of p*"'^(t„+i | t„,... ,to). The lat¬ 
ter can be found as dehned in (5). First of all notice that due to (25) 
and Cond4, p*'^^(t„,... ,to) is strictly positive for positive ISIs. This allows 
us to use it as denominator in the dehnition (5). Second, it can be fur¬ 
ther concluded from (25) and Cond4, that p*"'^(t„,... ,to) is bounded. The 
latter together with continuity of ... ,to) means that any disconti¬ 
nuity of jump type present in the ..., to) appears as well in the 

I It follows from the above and from Eq. (22) that 

the conditional pdf | t„,..., to) can be represented in the following 

form: 

I t„, . . . , to) = P"'(t „+1 to) + 

T ■^(tn+l) • • • ) to)x P6) 

where p’^(t„+i \ tn, ■ ■ ■, to) does not have any jump type discontinuity which 
position depends on to, and Z{tn+i, ■ • • ,to) is strictly positive function: 

77+1 

a n 

Z{tn+i, ■ ■ ■, to) = / * - 

P{tn, • ■ ■ ,to) 
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The representation (26) thns proves that for any n, conditional pdf | 

tn, ■ ■ ■ ,to) does depend on (the second term in (26)) and this dependence 
cannot be eliminated. □ 


4 Conclusions and Discussion 

Conclnsions made in [14] for the class of excitatory nenronal models are as 
well valid for the stndied here case of the class of fast CZ-type inhibitory 
nenronal models. Therefore, we do not replicate the text here in order to 
minimize overlap with the previons paper. 

At the same time, it is worth mentioning that the qnestion of to how 
extent the Poisson hypothesis is acceptable in nenroscience has been already 
discnssed, see [33]. The experimentally observed presence of memory in the 
ISIs ontpnt of real nenrons has been reported many times, see [34, 35, 36, 
37, 38]. Also several theoretical models of how the memory conld appear are 
offered, see [16, 39, 40, 41, 42, 43]. 

One more basic reason for non-Markov statistics in a nenronal network 
is revealed by B. Cessac in [44], where the discrete time model network of 
the standard leaky integrate-and-hre nenrons is considered. In this model, 
the internenronal commnnication lines have zero delays and external inpnt 
is deterministic, bnt synaptic weights are snbjected to nncorrelated random 
flnctnations. For this model, it is established in [44] that the stochastic pro¬ 
cess, which ontpnt is the set of bring states of all nenrons the network is 
composed of, will be non-Markovian as well. What conld be the reason of 
memory appearance in the stochastic process of nenronal bring states if there 
are no delays in this model? The ebect may be explained as follows. Any LIF 
nenron in the network considered loses memory abont its previons states at 
bring moment. Bnt nenrons, which do not bre at that same moment, still re¬ 
tain their memory abont their previons states. Therefore, the whole network 
retains some information abont its previons state after bring of any individ- 
nal nenron (provided all neurons do not bre synchronously) the network is 
composed of. The instantaneous bring state of the network specibes which 
neurons are in the bring state at a given moment t, but says nothing about 
state of neurons, which are quiescent at that moment. Knowledge of earlier 
bring states of the network can improve our predicting ability as regards 
states of the quiescent neurons at the moment t, and bnally, as regards the 
network bring state at the next moment, f -|- 1. This brings about a memory 
into the network’s stochastic activity. On the other hand, individual neu¬ 
rons in such a network can still have a Poisson-like activity, if not considered 
together, see example in [45]. 
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